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ABSTRACT 


A piecewise cross correlation technique has been developed to 
analyze the outputs of remote detection devices. The purpose 
of this technique is to eliminate the noise from optical back- 
ground fluctuations, from transmission fluctuations and from 
detectors by calculating the instantaneous product of the 
detector output and a reference signal. Each noise component 
causes positive and negative oscillations of the instantaneous 
product and may thus be cancelled by an integration of the 
instantaneous product. The resultant product mean values will 
then contain the desired information on the spatial and temporal 
variation of emission, absorption and scattering processes in 
the atmosphere. 

The piecewise correlation technique differs from previous digital 
analyses of stationary time series by separating statistical and 
temporal variations of product mean values. The statistical 
variations describe the amount of still uncancelled noise. The 
range of these variations is calculated by determining the fre- 
quency band width of the noise from the decrease of an accumu- 
lative statistical error with integration time. The temporal 
variations of the product mean values describe a change in the 
meteorological boundary conditions. They are indicated by the 
calculated errors which exceed the range of statistical varia- 
tions that is expected for the given noise band width. Further- 
more, such temporal variations set a level of irreducible noise 
components since the uncancelled noise cannot be distinguished 
from the temporal variations of the meteorological boundary 
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conditions. However, the change of these boundary conditions 
may very often be suppressed by suitable normalization and trend 
removal techniques. 

The accomplishments to date provide for automatic piecewise 
changes of gain factors and coordinate shifts which eliminate 
intolerable temporal variations of meteorological boundaries 
provided the signals do not exceed the dynamic range of the 
amplifier or the tape recorder. 

Our recommendations are to continue the present studies on noise 
elimination in the presence of time dependent boundary conditions. 
Particular emphasis should be given to the temporal variations of 
product mean values which are caused by changes in aerosol con- 
centrations, optical background fluctuations, variations of wind 
speed and changes of wind direction. Future development of piece- 
wise correlation techniques should concentrate on noise elimina- 
tion and interpretation of rapid scanning remote detection 
devices such that optical and meteorological phenomena might be 
monitored in real time. 


1 . INTRODUCTION 

A new "piecewise" correlation technique has been developed to eliminate 
noise in photometer outputs. The need for such a program became apparent in 
crossed beam field tests [Montgomery, 1969, this Vol.] where temporal varia- 
tions of meteorological boundary conditions sometimes produced irreducible 
noise components which were fatal. The new correlation techniques have sub- 
sequently isolated and eliminated temporal variations of meteorological bound- 
ary conditions by piecewise normalization and detrending procedures. The same 
techniques could also be applied to any other remote detection device or any 
other set of meteorological data. 

The noise elimination is based on the integration of a lagged product 
between the photometer output and a reference signal. Section 3 gives a 
review of the usual noise elimination by product integration which is used 
for stationary time series where the boundary conditions are time invariant 
[Bendat and Piersol, 1966]. The piecewise correlation was developed to extend 
this classical product mean value calculation to meteorological boundary con- 
ditions which are time dependent. In this case, the calculated product mean 
values will be subject to both statistical and temporal variations. In theory, 
temporal and statistical variations could be separated by analyzing a large 
group of imaginary experiments which should all have identical time dependent 
boundary conditions [Crandall and Mark, 1963]. This theory is reviewed in 
Section 4. However, it cannot be applied directly, since meteorological condi- 
tions cannot be controlled to give many realizations of the same phenomenon. 

The best one can hope for is that temporal variations of meteorological condi- 
tions are of such a type that suitably modified portions of one long record 
could be treated as independent realizations. The conditions of stationarity 
and the results of this approximation are discussed in Section 5. 

Our program is new in that the variations between different piecewise 
estimated time averages are used to calculate accumulative statistical errors 
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which should depend on the number of processed pieces in a universal way if the 
replacement of realizations with pieces is justified. Conversely, deviations 
from this behavior can be used to determine deviations from stationarity as 
discussed in Section 6. Temporal variations of meteorological boundary condi- 
tions restrict the noise elimination to the level of the temporal variations, 
since one cannot distinguish between statistical and temporal variations of 
product mean values. Fortunately, suitable normalization and trend elimination 
procedures are often sufficient to remove the temporal variations of boundary 
conditions. Piecewise variable ordinate shifts and gain factors have been pro- 
posed for trend elimination and normalization [Jayroe and Su, 1968]. The 
experience to date indicates that these piecewise modifications of photometer 
records were sufficient to remove temporal variations of boundary conditions 
and thereby increase the ability of noise elimination. The results are sum- 
marized in Section 7. Conclusions and recommendations are given in Section 8. 


2 . NOTATION 


a. 


Independent 

t 

T 

AT 

i 

m 

f 

T 


T =1/6 AT 
H 

k = 1,2, .. 


Variables 

observation time 

integration time 

piece length 

piece number (t/AT) 

accumulation number (T/ AT) 

frequency 

time lag between photometer output and reference 
s ignal 

maximum time lag 

N number of imaginary realizations. 


b. Dependent Variables 



d.c. coupled photometer output 
a.c. coupled photometer output 
output from photometer A 

reference signal or output from photometer B 
root mean square value of i 
product mean value of x and y 
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ar 

SR 

p 


AR 

a a 
x y 


statistical error of product mean value 
normalized statistical error of product mean value 


power inside frequency 


g f g 


M 


4t, 


M 


interval 


= ^R^ ordinate shift for piece i. 

c. Operators 

( ) Statistic 


i£T 


< >i 


AT 


( ) dt piecewise mean 


(i-l)AX 


m 


( = m ^ ^i accumulative mean 

i=l 


m 


A( ) m - m _ ^ piecewise statistical error 

i=l 


A( ) 


A( )„ = 


m 


m m 


accumulative statistical error 


e[TT] = I £ ( ) (k) 

k=l 


sample of expected value or ensemble 
average for one group of N realizations 


N 


(a (l) ) 2 = 


N - 1 


h=l 


(h) ___ 

( ) - E[( )] ) sample of variance between 

realizations 


+T 


max 


.( ) = 


2t 


max 


( ) dr average over time lags, 


-T 


max 
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d. Subscripts 


m 


x 


y 

a 

w 

d 


time interval (i - 1) ^ t = 1AT 

accumulation over all pieces up to i = m 

from record x 

from record y 

straight time integration 

weighting with piecewise variable gains 

detrending with piecewise variable 


c ordinate shifts 

C combined piecewise shifts and gains. 


3. NOISE ELIMINATION BY INTEGRATION OVER PRODUCTS 

The subdivision of two data records into signal and noise components and 
the subsequent elimination of the noise are both based on the integration of 
instantaneous products. This is illustrated in Fig. 1 in terms of an idealized 
physical model that is used for the interpretation of crossed beam results 
[Krause, 1967]. Two data records, I^Ct) anc ^ > are obtained by monitoring 

the fluctuations of the radiative power which is received inside the narrow 
field of view of the two telescopes, A and B. Each time history, I, accounts 
for all sources of radiative power along the entire line of sight. The tem- 
poral changes of emission, scattering, or absorption processes will cauae a 
fluctuation, i, in the recorded time history, I, which may be calculated by. 
subtracting the mean value, I, that is obtained for a certain recording period, 

/ST. 


ti+AT 

- yt> - sf / i A (t> dt - i A ct) - i A <t) 

t. 


y(t, . . .) = i B (t) - i B (t) 

In our experiments this subtraction is done automatically by using a.c. coupled 
amplifiers. In this case AC is proportional to the time constant of the a.c. 
coupling element (~ 100 seconds). 


Local information from the area of minimum beam separation is retrieved 
from the two signals, x and y, by determining statistically which modulations 
are "common" to both beams. The concept of "common signals has been developed 
in the analysis of communication signals and random vibrations [Bendat, Piersol, 
1966] and is based on "lagged product calculations." The two modulations, x 
and y, are analyzed for common signals by multiplying them with each other and 


559 



NOISE ELIMINATION BY PIECEWISE CROSS CORRELATION OF PHOTOMETER OUTPUTS 


B-BEAM A-BEAM 




Figure 1. Retrieval of Common Signals. 
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by averaging this instantaneous product over time. This gives a "two-beam pro- 
duct mean value: 


R (1) (t i; AT; . 


) = x(t; . . . )y(t; . . .) 


(i) 



+AE 


xy dt. 


( 2 ) 


The instantaneous product oscillates between positive and negative values 
and these oscillations will cancel each other, at least partially, when the 
product is averaged by integrating it over time, as illustrated in Figure 1. 
Two beams are said to have no common modulations if the two-beam product mean 
value vanishes. This complete cancellation will occur when the increase or 
decrease of radiative power in one beam is independent of the power changes in 
the other beam in the sense that the change in the other beam may be positive 
or negative with equal likelihood. Typical examples for such independent beam 
modulations are the combined source and detector noise and any cloud which 
traverses only one beam without hitting the other beam. The partial cancella- 
tion of the oscillations of the instantaneous product is used to split a given 
time history, x(t), into a "noise" component, x^, and a "common" component, x c . 
Both components are defined only with respect to a second reference signally. 
The noise component, x N , of the first record, x, is that component which vanishes 
when multiplied with the reference signal 


*H y 


(i) 


= 0 . 


(3) 


Conversely, the "common" component. 


x 

c 


x - V 


(4) 


is that component of signal, x, which is responsible for the finite value of the 
product mean value: 


y (l) = (* 


V 


,(i) _ 


X 


,( 1 ) 


(5) 


The second signal could also be split into a common component, y c , and a noise 
component, y N , by taking the first signal, x, as the reference signal: 


y 


= y c + V 


( 6 ) 


Substituting Eq. (6) into Eq. (5), one finds that the product mean value is 
made up only of the common signals. 
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The integration of the instantaneous product has thus eliminated the "noise" 
components and the resultant product mean value is contributed only by the 
signal component which is common to both data records, x and y. However, the 
word "common" does not mean that the components x c and y c are identical] It 
refers only to physical processes which produce a change simultaneously in both 
signals in such a way that the signs of these changes are either equal or 
opposite. A cloud which traverses two lines of sight (see Fig. 1) is a good 
example of such a physical process. Although this cloud will cause common 
changes in both photometer records x and y, these changes will be quite differ- 
ent since the two lines of sight intersect different portions of the same cloud. 


4. TEMPORAL AND STATISTICAL VARIATIONS OF PRODUCT MEAN VALUES 

The value of a product mean value, R, will depend in general on both the 
position, t, of the integration period and on the length, AT, of the period. 

The variation with t reflects a temporal variation of the meteorological bound- 
ary conditions such as a change of wind speed and direction or a new type of 
lng in the area which is common to both lines of sight. The dependence on AT 
may also reflect a temporal variation of the common signals. However, it is 
often more likely that the change is produced by the noise components which are 
not completely cancelled since any finite integration period will have over a 
finite number of oscillations of the instantaneous product. Such incomplete 
cancellation of extraneous noises reflects a change which may be classified as 
statistical, since it is associated with the uncontrollable change of physical 
phenomena other than the common physical process, i.e. , a random change in 
boundary conditions. Both temporal and statistical variations will mostly occur 
simultaneously and are therefore very difficult to separate. 

A detailed description of temporal and statistical variations of product 
mean values is possible, in theory, by treating the actual conducted experiments 
as one sample of a population of imaginary experiments which are all recorded 
for identical time dependent boundary conditions. Assume that k = 1, 2, 3,... N 
realizations of the atmospheric field have been observed. Statistical averages 
may then be established by averaging over the different realizations instead of 
averaging over time. This "ensemble" average shall be denoted by the operator 
and will be called the "expected value": 


N 


E[< »=l L () 

k=l 


GO 


( 8 ) 


Let x^ ^ (t) and y^ ^(t) denote the photometer records of the k-th realiza- 
tion. The expected value of the product mean value would then be 


N 

Efrlr] = i > — 
N A, AI 
k=l 


t x +AT 


* (k) (t> y< k> (t) dt.iV xW y <“> =r. 

™ L i 

k=l 


( 9 ) 
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The temporal variations of this ensemble average can be determined! since the 
time dependence of R(t AT, ...) is not cancelled when integrating across the 
ensemble. 


The statistical variations of the experimentally accessible product mean 
value r/ 1 ) can also be established by analyzing the variations between the 
individual realization, k, and the expected value. The "expected statistical 
variation of R^ 1 ) is provided by a mean square error calculation or "variance": 

VarTT^ 5 -— T ^ { ( )<k) ' »} ' <10) 

k=l 


A sample of the variance between individual product mean values is thus given by 


N 


Var R 


(i) 


N - 1 


k=l 

N 




’ r x< k y k) - E [x y] 


t i+AT 


N - 1L [AT 
k=l 


x (k) (t) y (k) (t) dt - R\- . 


( 11 ) 


The associated standard deviation, (Var R (l) ) l/2 , describes one likely variation 
between the individual realization, R< k >, and the expected value, R. Other varia- 
tions will occur with other probabilities. Fortunately, the practical implica- 
tions of the central limit theorem imply that the probability of mean value 
variations ought to follow the normal distribution. Knowing such a universal 
distribution, one can then calculate a certain limit, tp(Var R 0 1 ' , which 

will not be exceeded by the individual variations R( ' - R for the fraction p 
of all N realizations. These limits provide a confidence interval for the 
statistical variation between a single realization, k s 1, and the expected 
product mean value. The 80 percent confidence interval would be 


R (l) - to.go(N) (Var R (l) ) l/2 ^ R = R (l) + t 0 . 90 (N)(Var R (l) ) l/s . (12) 


The "percentile factors" of the normal distribution, tp, are listed in Table 1. 

Equation (12) gives the desired estimate for the expected statistical 
variations of individual product mean values. The associated confidence 
interval could be calculated if Var r( x ) were accurately known. However, 

Eq (11) gives only one sample of this variance. A new group of N realiza- 
tions would give a different sample of Var R'- 1 ' . The accurate description of 
the statistical variations should therefore consider not only the variations 
between individual realizations of a single group but also the variation 
between different groups of realizations. Let (oC 1 )) 2 denote the "population 
variance", which is calculated by taking the arithmetic mean of all samples of 
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TABLE 1 

Percentile Factors and Confidence Intervals for Stationary Records 


Student' s 

t Distribution 

X 2 -Distribution 

m 



Xf 90 

XfiO 

X. 9o/ m 

X. 10 /m 

2 

3.08 

.707 

2.71 

.0158 

.823 

.063 

3 

1.89 

.578 

4.61 

.211 

.716 

.153 

4 

1.64 

.500 

6.25 

.584 

.625 

.191 

5 

1.53 

.447 

7.78 

1.06 

.558 

.206 

6 

1.48 

.408 

9.24 

1.61 

.507 

.211 

7 

1.44 

.378 

10.6 

2.20 

.465 

.212 

8 

1.42 

.353 

12.0 

2.83 

.433 

.210 

9 

1.40 

.333 

13.4 

3.49 

.407 

.208 

10 

1.38 

.317 

14.7 

4.17 

.383 

. 204 

12 

1.35 

.288 

17.3 

5.58 

.347 

.201 

14 

1.34 

.267 

19.8 

7.04 

.318 

.190 

16 

1.33 

.250 

22.3 

8.55 

.295 

.183 

18 

1.33 

.236 

24.8 

10.1 

.277 

.179 

20 

1,32 

.222 

27.2 

11.7 

.261 

.174 

25 

1.32 

.200 

33.2 

15.7 

.230 

.160 

30 

1.31 

.183 

39.1 

19.8 

.028 

.150 

61 

1.30 

.128 

74.4 

46.5 

.142 

.112 

m oo 

1.28 

l/\[m 

m 

m 

l/\/m 

lA/m" 


Accumulative Means 


< >m- 


t A( ) 
p v 7 m 


SE[()]S() + t A() 

t \ / j v p v / m 


Normalized Accumulative Error 


X 


. 10 


X 


. 90 


S SR S 

to/bAT m WbAX 
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Var , i.e., the mean over all groups, 
variance estimate from a single group and 
then be expressed by the new variable. 


The relative variation between the 
the average over all groups could 


2 N Var R (l) (13) 

/ -, \ * 


The probability distribution of this variable is given by another universal dis- 
tribution function, the X 2 -dis tr ibution. Knowing this distribution, one can 
calculate a lower limit, X§. l0 (N) , which will be exceeded by the X samples of 
all but 10 percent of the admitted groups. One can also calculate an upper 
limit, X§. 9 o(N), which will exceed 90 percent of all X 2 samples. Both limits 
together then give a confidence interval for the statistical variation of 
variance estimates between different groups of realizations. The 80 percent 
confidence interval would be 


N Var R (l) £ ( -(i) )2 N Var Ili-l . 
Xq. 9 o(N) Xq. io(N) 


(14) 


The percentile factors Xo. io an< l X0.90 are also listed in Table 1. For N > 30 
they may be calculated from the equation [Spiegel, 1961] 


= \ (z„ W 2(N - 1) - l) 2 = N(1 - + 


n/2N - 3 


(15) 


In summary, we find that a single group of N realizations can provide the 
following samples; 

(a) The expected product mean value R, Eq. (9). 

(b) One sample, Var R^, for the desired statistical variations 
between the individual product mean values from different 
realizations, Eqs . (11) and (12). 

(c) The confidence interval for the statistical variations of 
variance estimates between different groups of N realizations, 
Eq. (14). 

^11 of these samples are based on universal distribution functions? which are 
independent from the particular physical process that produces the common 
signals. This universal behavior may therefore be used to separate the 
universal statistical variations of product mean values from specif ic tem- 
poral variations of these product mean values. One such possibility is dis- 
cussed in Section 6. 


565 



NOISE ELIMINATION BY PIECEWISE CROSS CORRELATION OF PHOTOMETER OUTPUTS 
5. STATISTICAL ERROR CALCULATION FOR STATIONARY DATA 

Unfortunately, the results of the last section cannot be applied directly 
to experimental data, since meteorological boundary conditions cannot be adjusted 
to obtain many realizations of the same meteorological conditions. The alterna- 
tive is then to assume that the meteorological boundary conditions are suffic- 
iently time invariant during one experiment such that individual pieces of a 
long record represent statistically independent realizations of these invariant 
boundary conditions. For this purpose, a long record of length T is subdivided 
into i = 1,2, ... m pieces of length AT = T/m. The time average over one of 
these pieces may be expressed by 


t=iAT 



t=(i-l)AT 


(16) 


Each of these piecewise estimates is then treated as if it came from a new 
realization. This means that the summation over realizations is replaced with 
a summation over pieces 


m mA T N 

Z ~i / < > dt - n I ( )<k> ■ E ' r>l - (i7 > 

i=l o k=l 

The following conditions [Bendat and Piersol, 1960] must be met to justify this 
replacement of realizations with pieces: 

(a) The time history of the statistic "( )" is a self-s tationary 
process . 

(b) The autocovariance function z(x) of this time history meets 
certain integrability conditions. 

(c) The individual piece length AT exceeds the time lag range within 
which the autocovariance z(t) has become negligibly small. 

Experimental data mostly meet the conditions (b) and (c) . However, the condi- 
tion (a) means that the replacement of realizations with pieces is only justi- 
fied if the temporal variations of the product mean value are negligible. Such 
time histories are called stationary. For such stationary time series all 
remaining variations are statistical. This means that the variations between 
piecewise averages and the statistical variations between sets of pieces should 
all follow the universal probability distributions given in the last section. 
The "fit" of these distributions may thus be used as a criterion for station- 
arity. One such criterion is developed in the remainder of this section. 

The desired criterion for stationarity considers the variations of 
"accumulative" averages which were defined in Eq. (17). The accumulative 
average of product mean values is derived by substituting Eq. (17) into 
Eq. (9). 
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R 


m 


m 



i=l 


m 


iAT 


1 

T 


x(t) y(t) dt 


i=l (i-l)AT 


N 



k=l 


x ( k ) y ( k ) 


R. 


(18) 


The statistical variations of these accumulative averages are derived from the 
differences between pieces. A sample for the expected variance, (O' ') , between 
any two pieces might be derived by substituting Eq. (17) into Eq. (10). This 
gives 


Var R 


(i) 


1 

(N - 1) 


N 


k=l 


| x< k > y< k > 



1 

(m - 1) 


m 


i=l 





(AR 




m 


(19) 


The associated standard deviation, A^ , will be called the piecewise error. 
Any new group of m pieces or m realizations would give another sample of the 
piecewise error. A confidence interval for the statistical variations of 
piecewise errors between different groups of pieces is derived by substituting 
Eq. (19) into Eq. (14). 


*LoC> 


, , m (4R 
g (o (l) ) 2 g m 


<i ) )2 


x: 


o. io 


(m) 


( 20 ) 


The statistical error of the accumulative mean, A^, should be much smaller 
than the error of a piecewise mean, A^, since the statistical variations 
between pieces will partially cancel each other during the summation. For 
stationary data the reduction will be equal to 1/m, since the cancellation 
accounts for m independent realizations of the same experiment. A sample of 
the mean square error of an accumulative mean is thus given by: 
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(A( ) ) 2 = ^ (A( )) ; 
m m m 


1 

m(m - 1) 


m 


i=l 



( 21 ) 


The associated standard deviation, AR^ will be called the "accumulative error." 
Any new group of m pieces or m realizations would give a new sample of the 
accumulative error. A confidence interval for the statistical variations between 
these groups is derived by substituting Eq. (21) into Eq. (20) and by dividing 
with m. The result is 


m (AR ) 2 

_ — IS g 

X 0.90< m ) 


(i) n2 “(£RJ : 


iO 

m 


m 


= X 2 


o. io 


(m) 


( 22 ) 


In most applications the accumulative error is normalized with the product of 
the accumulative root mean square values 



AR 


-HL. 


ZF7 1/2 (y 2 ) i/ 2 

v m w 'm 


(23) 


The confidence interval for the normalized accumulative errors follows by 
dividing Eq. (23) with the product of the accumulative root mean square values: 


. ^%). 2 g (^ (l) ) 2 

X 0 .90 (m) 

m m 


m (SRm) 2 . 

^o. io ( m ) 


(24) 


Expressing the population variance of piecewise means in terms of a "noise" 
band width, B, 


(5 



2 




Bzxr 


(25) 


and substituting this definition into the last inequality, one finds 


SL(pR m ) 2 g _J_ g m(5Rtn) 2 . 

^O. 90 (m) BT Xo. IO ( m ) 


( 26 ) 
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However, the two factors, m/X 2 and m/Xo >10 ,both asymptotically approach the 
value, 1, according to Eq. (14^. 6 * * 9 °Theref ore , Eq. (25) gives the well known result 
that the relative statistical error of a product mean value should decrease with 
the inverse square root of integration time. 


AR , 

6 R = 2 _> 1 . (26a) 

0^i/2Ypyi/2 (BT) 1 / 2 

m m 

Direct calculations of the accumulative statistical error, AR m ,may thus be used 
to determine the noise band width, B, from the asymptotic decrease of this error 
with the inverse square root of integration time. Furthermore, the knowledge 
of this band width can then be used to calculate the confidence levels for the 
relative accumulative error. Rearranging the two inequalities of Eq. (26), 
one gets 


*0.10 (“) — Xo.9o( m ) 

S &R S — — . (27) 

m n/b A T m m n/bAT 


Figure 2 illustrates such a direct calculation of the confidence interval 
that is expected for stationary data. This example employs product mean values 
from a crossed beam test in a supersonic jet. The abscissa is given by the 
inverse square root of integration time, T, or accumulation number, m = T/AT. The 
ordinate gives the relative statistical error which was calculated from Eq. (21). 
The actual data follow a straight line through the origin very closely as pre- 
dicted by Eq. (26a). The slope of this line gives a noise band width of 
B = 22,276 cps. This noise band width has been used to calculate the confidence 
intervals according to Eq. (27) and Table 1. All directly calculated statis- 
tical errors fall into this interval. One can thus say that the probability is 
better than 80 percent that the entire record was stationary. 

By processing m = 14800 pieces, it was also possible to reduce the statis- 
tical error Z\R m °f the accumulative product mean value, R m , to 0.2 percent of the 
mean square value of the actually recorded integrated signals. This demon- 
strates the surprising power of digital correlation techniques to retrieve very 
small signals out of noise. The successful development of the associated 
"piecewise" correlation computer program and the success of crossed beam 
detection of wind profiles and turbulence parameters in subsonic and super- 
sonic jets [Fisher, Krause, 1967] with the program provided the basis and the 
starting point for extending crossed beam measurements into the atmosphere. 


6. DEVIATIONS FROM STATIONARITY AND IRREDUCIBLE NOISE 

Fluctuation measurements with winds, humidity, and temperature sensors on 
meteorological towers indicate that the power spectra of these fluctuations 
may contain significant energy for frequencies down to 0.01 cps, i.e., for 

periods as long as 2 minutes. The length of one piece should be two to five 
times larger than this period if such pieces are to be treated as independent 

realizations of the same meteorological conditions. We chose a piece length 
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Figure 2. Noise Elimination for Stationary Wind Tunnel Data. 
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of AT = 450 sec = 7.5 minutes for most of our work. At least 5 different 
realizations of a physical phenomenon are then required to establish the level 
or irreducible noise components and nons tationarities from the statistical 
variations between these pieces. 

We have chosen to illustrate the noise and stationarity analysis for a 
marginal case where only 6 pieces are available. The test conditions and te 
photometer records x(t) and y(t) are shown in Fig. 3 The piecewise means of 
photometer output "A", x i? are shown in Fig. 4a together with the accumu a 
mean,x 6 ,of these means. Furthermore, the statistical error of the individual 
piecewise mean, Ax 6 , is added and subtracted from each piecewise mean. The 
striking observation is that the mean of piece 6 makes a sudden jump which is 
so large that it exceeds the statistical errors. In case of stationary data, 
the different values of the piecewise means should stay within the confidence 
interval given by Eq. (12). The observed large jumps fall, however, outside 
such an interval; therefore, it is unlikely that these jumps are of a statis- 
tical origin. One should rather anticipate sudden changes m the meteorologica 

boundary conditions. 

The deviation from stationarity, which is anticipated because of the large 
jump of the sixth piecewise mean, is clearly indicated by the accumulative error 
of these means. These errors were calculated according to Eq. (21) an P 
aeainst T" 1 ? 2 as shown in Fig. 4b. The expected stationary process was then . _ 
defined by fitting the calculated points with a straight line through the origin. 
The slope^f this line gives a noise band width of B - 0. 19 cps, which is then 
used to calculate the 80 percent confidence interval according to Eq. ( )■ 
However the directly calculated errors increase suddenly between pieces 5 and 
find exceed the confidence interval. This exceedance illustrates clearly the 
deviation from stationarity that was anticipated from the above visual inspec- 
tion of Fig. 4a. 

The exceedance of the confidence interval can be used to define and 
analyze a deviation from stationarity in many different ways. Fig. 4b i 
tratL the most simple of all classifications which completely disregards the 
shapfof thl actual error curve. A period of a record is called stationary if 
the accumulative error falls within the 80 percent confident 6 interval ofjhe 
expected stationary process. Conversely, a period of a recor i 
stationary if the calculated errors exceed the expected confidence interva . 

The experience which was gained with this classification is summarized m 

Table 2. 

The second important aspect of the accumulative error curves is the esti- 
mate of the irreducible amount of noise. Such an analysis is based on. 
results of the last section, which should apply within a period of stationarity. 
According to the discussion of equations « (9) and (11), the accumulative statis- 
tical error will be contributed predominantly by the uncancelled noise compo- 
nents since the meteorological boundary conditions are time invariant in a 
period of stationarity. The finite extent of the period of stationarity means , 
therefore, that an irreducible amount of noise exists which is. equal to t e 
lower limit of the accumulative statistical error inside the given period, 
calculation of statistical error curve, ^(T), will therefore provide a direct 
estimate of the irreducible noise for each period of stationarity as Ulus ra 

in Fig. 4b. 
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Table 2 

Preliminary Experience on Temporal Product Mean Value Variations 



Straight Time Integration 

Piecewise 

Gain Change 

Run 

^max ® 

(sec) (cps) 

Ti 

(sec) 

t 2 

(sec) 

Ti-T 2 

(SR) . 
min 

Tx 

(sec) 

T 2 

(sec) 

Ti-t 2 

(SR) . 
'min 

^max 

(%) 

^max 

(%) 

A 

6750 .063 

NA 

NA 

0 

NA 

0 

6750 

100 

.050 

B 

4050 .044 

NA 

NA 

0 

NA 

0 

4050 

100 

.067 

C 

4500 .045 

3600 

4500 

20 

.078 

0 

4500 

100 

.052 

D 

7200 .063 

2250 

7200 

62 

.060 

0 

7200 

100 

.046 

E 

3240 .063 

NA 

NA 

0 

NA 

0 

3240 

100 

.065 

F 

4950 .012 

0 

4950 

100 

.060 

450 

4950 

91 

.045 

G 

4500 .111 

NA 

NA 

0 

NA 

0 

4500 

100 

.044 

H 

10350 .250 

NA 

NA 

0 

NA 

0 

10350 

100 

.019 

I 

2700 .063 

NA 

NA 

0 

NA 

0 

2700 

100 

.040 


T x - start of stationary period 
T 2 = end of stationary period 


— = — * - percentage of stationarity 
■‘•max 

NA = not applicable. 


7. PARTIAL REMOVAL OF TEMPORAL VARIATIONS BY PIECEWISE ORDINATE 
SHIFTS AND GAIN FACTORS 

The existence of an irreducible amount of noise would be fatal to crossed 
beam experiments if this irreducible noise exceeds the small levels of the 
common signal. However, the results of the last section imply that the 
"irreducible" amount is inversely proportional to the length of the period 
of stationarity. If one could partially remove the temporal variations of 
the meteorological boundary conditions, then the amount of "irreducible" 
noise might be further reduced by allowing a longer period of stationarity. 

In other words, the term "irreducible" applies only to a straight time inte- 
gration as described by Eq. (16). Averaging procedures other than time inte- 
gration might provide smaller "irreducible" noise levels by removing the time 
dependence of boundary conditions through suitable normalization and trend 
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elimination procedures. Jayroe and Su proposed the concept of "accumulative" 
means which differ from straight time integration by employing piecewise 
variable ordinate shifts and gain factors [Jayroe and Su, 1968]. The applica- 
tions of these shifts and gains will now be discussed for the same test run 
that has already been used. 

A piecewise variable ordinate shift may be described as an attempt to 
remove large scale (i.e., low frequency) trends. Consider lagged product mean 
values which differ from the product mean values of Eq. (2) only by delaying 
signal x relative to signal y: 


LCt) = x ( t - t) y(t) i 


i£T 


I x(t - t) y (t) dt. 


(i-l)AT 


(28) 


This lagged product mean value (or temporal correlation function) is calculated 
for equally spaced time lags and truncated at a time lag 

T =7" AT. 
max 6 


Figure 5a shows such a piecewise estimated correlation function for piece 1 of 
our test run (Fig. 3). The ordinate of this correlation curve shall then be 
shifted by an amount P i (0) which makes the area under the shifted curve vanish. 


+T 


max 


P t (0) 


2t 


max 


R. (t) dr. 
r 


max 


(29) 


This ordinate shift is equal to the cross power inside the narrow frequency 
band 




A£ • S(f -» 0) 



lim 

f=0 


+co 

/ ’ - , N -i2jtf T , 

/ R^(t) e dr 

-00 


+00 



R t (T) 


dr = (0) . 


( 30 ) 


The ordinate shift 5^(0) therefore removes all power at frequencies below 
1/4 t m , i.e., all slowly varying trends. The ordinate shift may thus be 
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Figure 5. Removal of Low Frequency Components Through 
Piecewise Ordinate Shifts. 


F. R. Krause and B. C. Hablutzel 


described as a piecewise trend elimination method. The application of this 
detrending procedure leads to the following accumulation average. 



m 



i=l 


P^O)). 


(31) 


Figure 5b shows the ordinate shifts, P^O), which have been calculated 
for the six pieces of our test run. These shifts oscillate between positive 
and negative values in such a way that the accumulative shift, P m (0), stays 
very small. Apparently, the temporal variations of product mean values (Fig. 
5c) may be insignificant, although the temporal variations of the mean values 
(Fig. 4a) are large. 

Piecewise ordinate shifts are effective in removing trends. However, in 
many cases the temporal variations of the boundary conditions will also cause 
changes at higher frequencies. One change that was observed often is a piece- 
wise jump of fluctuation amplitudes. The average fluctuation amplitude, a, for 
a piece is given by the root mean square value 


-2 

a . 
xi 


_1_ 

AT 


iAT 

x 2 dt. 
(i-l)AT 



(32) 


Temporal variations of fluctuation amplitude are then indicated by the varia- 
tions of this root mean square value. Figure 6 illustrates this variation 
for the test run. The temporal variation of the boundary condition that was 
discovered (Fig. 4b) also, apparently, causes a large jump of the amplitude . 
between pieces 5 and 6. However, the effect of this jump could be minimized 
by normalizing with the associated root mean square value. This would reduce 
the fluctuations of the normalized signal x/a xi to the level of the previous 
pieces. The opposite would be true with a piece that is characterized by a 
sudden decrease of fluctuation levels. Temporal variations of signal ampli- 
tudes can thus be suppressed effectively by using a piecewise bariable gain 
factor which is proportional to l/a ± . Such a nondimens ional gain factor has 
been defined by multiplying l/a± with the accumulative root mean square value 


_2 

a 

m 




(33) 


The application of this gain, a/a, leads to a new type of accumulative average 
which may be denoted by 




yrn 



i=l 


o . a . 

xi yi 


(34) 
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Combined weighting and detrending gives a fourth type of accumulative average: 


(R ) 
v m c 






P ± (0) 


i=l 


a . a . 
xi yi 


( 35 ) 


All of these different accumulation procedures may be summarized by the use of 
a unified accumulative average. 


R(t; m; . . . ) 


a a 


xm ym 
m 




x y 


( 36 ) 


which allows for a free choice of gain factors, a/o, and ordinate shifts, s. 
The various options that have been tried to this date are characterized by 
the following choices: 


Straight time integration; subscript a 


a 

x 




Piecewise detrending: subscript d 


'{■I 


a 


x 




s . 

1 


P^O). 


Piecewise weighting: subscript w 



Combined detrending and weighting: subscript c 


a 

x 


a . ; 

xr 



s . 

i 


P.(0). 


The value of these choices may be judged from the behavior of the associated 
accumulative statistical error. 


(&R(t; T; m ) 2 


£R(t, T,m) 


'a a 

xm ym 


1 _ 

m(m - 


1 ) 


i=l 



s . 
l 


a 

x 



a 


y 



( 36 ) 
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The desired accumulation procedure should suppress the temporal variation of 
meteorological boundary conditions. According to section 6, this suppression 
may be judged by fitting the tail (m large) of the error curve with a straight 
line. The best accumulation procedure is the one that gives the best fit. 
Furthermore, the slope of that line gives the noise band width, B, of the piece- 
wise modified noises and can be used to calculate the confidence interval for 
the entire error curve from Eq. (27). The whole procedure is illustrated in 
Fig. 7 for the test run and differs from the illustration given in Fig. 4 in 
the following aspects: 

(a) The statistical error refers to product mean values, not 
mean values . 

(b) The time lag dependence of the product mean value has been 
cancelled by integration: 


SR 2 (T;m) 

T 


1 


2t 


max 


+T 

max 

n 

J 5R 2 (t; 

-T 

max 


T; m) dx 


(37) 


(c) Four different error curves have been calculated using the dif- 
ferent options for piecewise shifts and gains that were 
identified above by the subscripts a, d, w and c. 


The straight time integration, curve a, indicates that both the beginning 
and the end of the record are strongly affected by temporal variations of 
the boundary conditions. These variations cannot be described by low fre- 
quency trends since the piecewise detrending, curve d, is not effective to 
alter the shape of the error curve. Only the use of piecewise gains pro- 
duces error curves (c and a) which approximate a straight line through the 
origin. The slope of this line gives a bandwidth B = 0.063 cps, which in 
turn is used to calculate the confidence interval X/ rrW BAT7 Both curves w and 
c fall into this interval; i.e., the piecewise modified photometer records 
are stationary with_a probability exceeding 80 percent. The smallest error 
of these curves, T SR ~ 0.075, gives then the irreducible amount of noise that 
is left after accumulating over a period of T = 45.00 = 2700 seconds. A 
further noise reduction would require a longer record. 

The use of piecewise gains proved to be a very powerful tool in cases 
where the meteorological boundary conditions were known to be highly time 
invariant. One of the more dramatic changes of meteorological conditions 
under clear skies is the change of wind direction. Fig. 8 provides an 
example of piecewise gain changes for moderate fluctuations of wind direc- 
tions (± 22°, run H) . Without piecewise gains we get a curve that fits the 
confidence interval; however, this curve does not exhibit the desired straight 
line fit. The use of piecewise gains improves the approximation of a sta- 
tionary record significantly and also slightly improves the noise elimination. 
Figure 9 provides an example for extreme temporal variations of boundary con- 
ditions (±180°, run A). The wind was blowing from all directions during the 
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SYMBOL I ACCUMULATION METHOD 


STRAIGHT TIME INTEGRATION 
{ )j = R j , <r = 


PIECEWISE GAINS 

f~)j = Rj , <r z U 2 )i i/2 ‘, (y 2 )j 1/2 

PIECEWISE SHIFTS ~ _ 

Hj = Rj - Pj(o), <r z (» 2 )m /2 > (y 2 Vn 

COMBINED PIECEWISE GAINS AND SHIFTS 
Mi - Rj - Pi (0), <r = (^)jV2 } (7)i 1/2 


NORMALIZED STANDARD ERROR 


(T ( S6C ) ) 


T(sec) 


2700 1800 1330 


Figure 7. Application of Piecewise Shifts and Gains to Test Runs 
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BEAM SEPARATION = 72 m 

WIND DIRECTION FLUCTUATIONS = ± 22 deg 


= a -TIME INTEGRATION 

^ _ picrcu/iCF gaimc 



Figure 8. Removal of Temporal Product Mean Value 

Variations with Piecewise Gains (Run H) . 
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BEAM SEPARATION = 0 

WIND DIRECTION FLUCTUATIONS = ± 1 80 deg 

a - TIME INTEGRATION 
w- PIECEWISE GAINS 


X.90 V/" 

mi/eiT // 

I / 

!/ . EXPECTED 

// / STATIONARY 

// /V \ PROCESS 

// / 

! / 

/ / / 




TEMPORAL L' 
VARIATION 1/ 




W X - 10 
/ B' 1/2 =(.063cps)" 1/2 mTiAT 


T ^ 2 (sec -1 ' 2 ) 


Figure 9. Removal of Temporal Product Mean Value 
Variations with Piecewise Gains (Run A) 
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recording period. In this case, the straight time integration produces an 
error curve which does not resemble a stationary process at all. However, 
even in this extreme case the use of piecewise gains proves sufficient to 
eliminate the temporal fluctuations of product mean values. 

Our preliminary experience with the application of piecewise correlation 
methods indicates that temporal variations of product mean values occur quite 
frequently for observation periods between 1/2 and 2 hours. Table 2 gives a 
summary of the first 9 runs where statistical and temporal product mean value 
variations were separated. In six out of nine runs the temporal variations of 
stationarity did not exist at all. Two of the six cases are illustrated in 
Figs. 7 and 9. 

For record lengths up to 2 hours, the use of piecewise gains and ordinate 
shifts has always been sufficient to remove temporal variations of product 
mean values provided that the amplifier or tape recorder is not driven into 
saturation by these temporal variations. Saturation by a large temporal 
variation of meteorological conditions however always occurred and was the 
dominant factor which determined the maximum record length, T. Elimination 
of this saturation problem should allow longer recording times and thereby 
contribute to a further reduction of noise below the values of (SR) . that 
are listed in Table 2. min 


8. CONCLUSIONS AND RECOMMENDATIONS 

The piecewise correlation technique was developed to eliminate noise in 
the output of remote detection devices. The noise is reduced by multiplying 
the photometer output with a reference signal and by integrating this instan- 
taneous product over time. This method is quite common for stationary time 
series where the boundary conditions of the experiment are time invariant. 

The piecewise correlation technique is new by extending this elimination of 
noise to meteorological boundary conditions which are time dependent. The 
simple time integration of products cannot reduce the noise level below the 
level of temporal variations, since one cannot distinguish between statistical 
and temporal variations of the product mean value. 

The mathematical theory of product mean value variations is based on the 
difference between a large group of imaginary experiments, all of which have 
the same time dependent boundary conditions. This theory cannot be applied 
directly since meteorological conditions cannot be controlled to repeat 
themselves many times. However, individual pieces of a long record may often 
be normalized and detrended in such a way that the resultant piecewise modi- 
fied data behave as if they belonged to independent realizations of the same 
meteorological boundary conditions. Piecewise correlation techniques are thus 
based on the premise that one can, in most cases, find suitable piecewise 
modifications of the photometer outputs and the reference signal which produce 
two new signals that are stationary although the experiment itself is quite 
nonstationary. 

The effect of piecewise modifications of the photometer outputs may be 
judged by curve fitting the resultant accumulative error curve with a straight 
line. The modifications have been successful if the accumulative error 
decreases linear with the inverse square root of integration time. The slope 
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of the straight line fit gives the frequency band width of the noise components 
which one wishes to suppress. Knowing this band width, one can also calculate 
a confidence interval that should contain most of the calculated statistical 
errors. Temporal variations of product mean values are then indicated by 
those errors which fall outside this confidence interval. 

The experience gained with piecewise correlation techniques indicates that 
significant temporal variations of product mean values do occur quite fre- 
quently (50 percent of all runs). However, these temporal variations have been 
removed successfully by employing piecewise changes of gain factors and piece- 
wise ordinate shifts. The proposed automatic changes of gains and ordinates 
are thus suitable piecewise modifications. They have successfully reduced the 
temporal variations of product mean values below the level of the statistical 
variations in all cases where the temporal variations of the meteorological 
boundary conditions did not drive the amplifier or the tape recorder into 
saturation. 

The piecewise correlation technique provides a new tool that can distin- 
guish between statistical and temporal variations of product mean values. The 
statistical variations are due to the still uncancelled noise and the temporal 
fluctuations are caused by a temporal change in meteorological boundary condi- 
tions. We recommend continuing the present studies of noise elimination in 
the presence of time dependent meteorological boundary conditions. Particular 
emphasis should be given to the temporal variations of product mean values 
which are caused by changes in aerosol concentrations, optical background fluc- 
tuations, variations of wind speeds and changes of wind direction. 

The above recommendation is based on the technical problems that were 
encountered in our first cross beam field tests. These problems and the pro- 
posed solutions may be described as follows. 

Temporal variations of local scattering process were frequently observed 
under clear skies which are so large that both the a.c. amplifiers and tape 
recorders are driven into saturation. Amplifier saturation is being reduced by 
installing a new coupling circuit with a stepwise variable time constant that 
is triggered by the incoming signal. Tape recorder saturation will be elimin- 
ated by replacing the analog recorder with an on-line digital data logging 
system. 

Temporal variations of the optical background radiation were caused by 
distant clouds and haze which drift through the photometer's field of view. 

The associated background noise far exceeds the signal contributions from the 
desired target layers and may be so large that it cannot be reduced sufficiently 
by integration of products. In crossed beam tests these background fluctua- 
tions have been suppressed by pointing the telescopes to the horizon beneath 
the cloud level. Infrared photometer systems are now being assembled which 
should suppress the background fluctuations by setting the monochromator band- 
pass to a spectral region where the optical path length terminates below the 
cloud level. 

Temporal variations of wind speeds have often caused the dominant tern 
poral variations of product mean values. One promising approach to eliminate 
noise in the presence of speed fluctuation is to replace the photometer output 
with its time derivative. The correlation of time derivatives is presently 
being employed to retrieve the probability density of wind component fluctuations. 
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Large temporal variations of wind directions change the altitudes where 
the common signals originate. A single-beam fan arrangement is being assembled 
which sets a fan of six narrow fields of view by mounting a plurality of photo- 
diodes in the focal plane of the collector optics. A new piecewise correla- 
tion program is being coded for multichannel operation to process the output 
from several detectors simultaneously. The fan system will then be used to 
study the altitude "distribution of the common signals and the restrictions on 
altitude resolution that are imposed by large wind direction changes. 

A successful elimination of noise in the presence of time dependent 
meteorological boundary conditions would provide an opportunity to extend 
remote detection techniques to the description of dynamic phenomena such as 
winds and turbulence. In particular, the theory of a rapid scanning crossed 
beam system [Krause, et al . , 1966] indicates that wind and turbulence profiles 
could conceivably be monitored in real time with a single flyby. Furthermore, 
a crossed beam system which is mounted on an airplane or a satellite moves so 
rapidly that temporal variations of wind speed and wind direction should no 
longer interfere with the noise elimination [St. John and Blauz, 1968]. Our 
recommendation for future studies is therefore to develop piecewise correla- 
tion techniques and onboard computer systems for rapid scanning remote detec- 
tion devices such that space and time variations of optical and meteorological 
phenomena might be monitored in real time in regions where balloons are not 
available. 

We hope to continue our present field test programs to collect design 
information that could be used for the development of rapid scanning remote 
detection devices. The long range objective of these field tests is to 
isolate the space time variations of local emission, absorption and scatter- 
ing processes at various altitudes and to determine the irreducible amount of 
noise which is imposed by the variations of the meteorological boundary condi- 
tions. The design of airplane instrument packages and of on-line computer 
systems should be initiated as soon as the results of the continued field 
tests indicate the feasibility of such a step. 
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